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Abstract. The 9-Neumann problem is the fundamental boundary value 
problem in several complex variables. It features an elliptic operator 
coupled with non-coercive boundary conditions. The problem is glob- 
ally regular on many, but not all, pseudoconvex domains. 

We discuss several recent developments in the L 2 -Sobolev theory of 
the 9-Neumann problem that concern compactness and global regularity. 



1. Introduction 

The 9-Neumann problem was formulated in the fifties by D. C. Spencer as 
a means to generalize the theory of harmonic integrals (i.e. Hodge theory) 
to non-compact complex manifolds. For domains in C n , which is the context 
we will restrict ourselves to almost exclusively in this paper, the problem can 
be formulated as follows. Denote by f2 a pseudoconvex domain in C n , and by 
L(o q) (^) t ne space of (0, g)-forms on f2 with square integrable coefficients. 
Each such form can be written uniquely as a sum 



(1.1) u = ujdzj 



where J = (ji, • • • ,j g ) is a multi-index with ji < j2 < ■ • ■ < jq, dzj = 
dzJ^A ■ ■ ■ AdzJ^, and the ' indicates summation over increasing multi-indices. 
The inner product 

(1.2) (u,v)= [S2ujdzJ,S2vjdzj) = U JVJ 

turns L?„ (O) into a Hibert space. Set 



n I ^ 

OU., 



(1.3) 3 ( J2 u J dz -jJ = Yl ii=^ A dzj 
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where the derivatives are computed as distributions, and the domain of d 
is defined to consist of those u G L 2 0( ^(f2) where the result is a (0, g+ In- 
form with square integrable coefficients. Then d = d q is a closed, densely 
defined operator from L 2 Q( ^($7) to L 2 Q q+1 j(£l), and as such has a Hilbert 

space adjoint. This adjoint is denoted by d q . (We will not use the subscripts 
when the form level at which the operators act is clear or not an issue.) One 
can check that dd = 0, so that we arrive at a complex, the d (or Dolbeault)- 
complex: 

In analogy to the Laplace-Beltrami operator associated to the DeRham com- 
plex on a Riemannian manifold, one forms the complex Laplacian 

(1.4) □,=3,_is;_ 1 +s$ M 

with domain so that the compositions are defined. The 3-complex is ellip- 
tic. The 5-Neumann problem is the problem of inverting O q ; that is, given 
v G L? Qq JQ), find u G Dom(D 5 ) such that O q u = v. Note that Dom(d g ) 

involves the two boundary conditions u G Dom(<9*) and du G Dom(<9*); 
these are the 9-Neumann boundary conditions. The condition u G Dom(<9*) 
is equivalent to a Dirichlet condition for the (complex) normal component 
of u. Similarly, the condition du G Dom(9 ) is equivalent to a Dirichlet con- 
dition on the normal component of du, that is, a complex (or d-) Neumann 
condition for u. 

From the point of view of partial differential equations, the d- Neumann 
problem represents the prototype of a problem where the operator is elliptic, 
but the boundary conditions are not coercive, so that the classical elliptic 
theory does not apply. From the point of view of several complex variables, 
the importance of the problem stems from the fact that its solution provides 
a Hodge decomposition in the context of the 9-complex, together with the 
attendant elegant machinery (as envisioned by Spencer). For example, such 
a decomposition readily produces a solution to the inhomogeneous d equa- 
tion, as follows. Assume for the moment that D g has a (bounded) inverse 
in L^ 0( ^(S7), say N q . Then we have the orthogonal decomposition 

(1.5) u = W*N q u + d*dN q u , u G L 2 ( ^ q) (Q) . 

If du = 0, then d*dN q u is enclosed as well (from (|1.5[l l. Consequently, 
d* dN q u = (since it is also orthogonal to Ker(<9)), and 

(1.6) u = d(d*N q uj , 

with ||9*iVgM|| 2 = (dd*N q u,N q u) < C\\u\\ 2 . Thus the operator d* N pro- 
vides an L 2 -bounded solution operator to d. In fact, this operator gives 
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the (unique) solution orthogonal to Ker(<9) (equivalently: the solution with 
minimal norm). This solution is called the canonical (or Kohn) solution. 

That O q does have a bounded inverse N g on bounded pseudoconvex do- 
mains was known by the mid sixties. Kohn ( |631 1641 I65| ) solved the d- 
Neumann problem for strictly pseudoconvex domains, showing that in this 
case, not only is there an L 2 -bounded inverse, but N q exhibits a subellip- 
tic gain of one derivative as measured in the L 2 -Sobolev scale. Another 
interesting approach was given by Morrey in [7S]. Hormander see 
also Andreotti-Vesentini |Tj for similar techniques) proved certain Carleman 
type estimates which in the case of bounded pseudoconvex domains imply 
the existence of as a bounded self-adjoint operator on L 2 Q( ^(f2). Early 
applications included embedding of real analytic manifolds f [77l 178] ). a new 
solution of the Levi problem ([HI]), a new proof of the Newlander-Nirenberg 
theorem on integrable almost complex manifolds ( 64 ; ), and in general, an 
approach to several complex variables which takes advantage of the then 
newly developed 3-methods (|S3[58J. Interesting 'eyewitness' accounts of 
this foundational period by two of the principals appear in jj>§] and |68| . 
respectively. 

It is not hard to see that Kohn's results for strictly pseudoconvex domains 
are optimal: N can never gain more than one derivative, and it can gain 
one derivative only when the domain is strictly pseudoconvex. However, un- 
der what circumstances subellipticity with a fractional gain of less than one 
derivative holds was not understood until the early eighties. Kohn gave suf- 
ficient conditions, satisfied for example when the boundary is real-analytic, 
in |66j . In deep work, his students Catlin ( |18[ I19| 121 j ) and D'Angelo 
( [2H1 EH1 EOj ) resolved this question: on a smooth bounded pseudoconvex 
domain in C n , the 9-Neumann problem is subelliptic if and only if each 
boundary point is of finite type, that is, the order of contact, at the point, of 
complex varieties with the boundary is finite. For more on these ideas, see 

[32 El E2 EH]- 

When N q does not gain derivatives, but is still compact (as an operator 
on L 2 0( ^(f2)), it follows from work of Kohn and Nirenberg (|70|) that N q 
preserves the Sobolev spaces W^ Qq ^(0.) for all s > 0. In particular, N q 
preserves C^Jti) (it is globally regular). Work of Catlin (jSOl, compare also 
Takegoshi [2lj) and Sibony (jHSl) shows that compactness provides indeed a 
viable route to global regularity: the compactness condition can be verified 
on large classes of domains. We refer the reader to [IHl for a survey of 
compactness in the 3-Neumann problem. In section 2 below, we will discuss 
some developments that have occurred since the publication of |46| . 

In addition to the 'usual' (pde) reasons for studying regularity properties 
of a differential operator, there are, in the case of the <9-Neumann problem, 
the implications global regularity of the 9-Neumann operator has for several 
complex variables. Chief among these is the relevance for boundary behavior 
of biholomorphic or proper holomorphic maps. Namely, if f2i and 0,2 are two 
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bounded pseudoconvex domains in C n with smooth boundaries, such that 
the <9-Neumann operator on (0, l)-forms (i.e. N\) on f2i is globally regular, 
then any proper holomorphic map from f^i to Q2 extends smoothly to the 
boundary of f^i (jZHHIl)- This is a highly nontrivial result: in contrast to 
the one variable situation, where the result is classical, the general case in 
higher dimensions, even for biholomorphic maps, is open. An exposition of 
the ideas and issues involved here can be found in [6j I7T| 123]. 

That global regularity holds on large classes of pseudoconvex domains 
where local regularity or even compactness fail was shown in the early 
nineties by Boas and the author ( Jill I13| ). They proved in 11 that if f2 
admits a defining function whose complex Hessian is positive semi-definite 
at points of the boundary (a condition slightly more restrictive than pseu- 
doconvexity) , then the d- Neumann problem is globally regular (for all q). 
This class of domains includes in particular all (smooth) convex domains. 
The proof is based on the existence of certain families of vector fields which 
have good approximate commutator properties with d. In |13| . the authors 
studied the situation when the boundary points of infinite type form a com- 
plex submanifold (with boundary) of the boundary of the domain. They 
identified a DeRham cohomology class associated to the submanifold as the 
obstruction to the existence of the vector fields needed. In particular, a 
simply connected complex manifold in the boundary is benign for global 
regularity of the 9-Neumann problem. It is noteworthy that this cohomol- 
ogy class also plays a role in deciding whether or not the closure of the 
domain admits a Stein neighborhood basis (jSJ). 

The question whether global regularity holds on general pseudoconvex 
domains turned out to be very difficult and was resolved only in the mid 
nineties. Barrett (j5|, see also j2] and [HI] for predecessors) showed that on 
the worm domains of Diederich and Fornagss ( |38|). N\ does not preserve 
W? Ql JO,) for s sufficiently large, depending on the winding (that is, exact 
regularity fails). Christ (j2U) see also [251 I26| ) resolved the question by 
proving certain a priori estimates for N% on these domains that would im- 
ply exact regularity in Sobolev spaces (and thus would contradict Barrett's 
result) if N\ were to preserve the space of forms smooth up to the boundary. 

In section 3, we will discuss some recent developments. In |92| and |44| . 
the authors consider the case where the boundary is finite type except for a 
Levi-flat piece which is 'nicely' foliated by complex hypersurfaces. Whether 
or not the families of vector fields with good approximate commutator prop- 
erties with d exist turns out to be equivalent to a property of the Levi foli- 
ation much studied in foliation theory, namely whether or not the foliation 
can be defined globally by a closed one-form. Sucheston and the author 
showed in j^J that the approaches via plurisubharmonic defining functions 
and vector fields with good approximate commutator properties with d are 
actually equivalent, when suitably reformulated. This left two main avenues 
to global regularity: compactness and plurisubharmonic defining functions 
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and/or good vector fields. These two approaches were unified by the author 
in [201, y i a a new sufficient condition for global regularity. 

Detailed accounts of the <9-Neumann theory, from different points of view, 
may be found in [J21 EH1 ED E31 E21 EH ■ Developments up to about ten years 
ago are covered in ^1] (for compactness, see HO])- Two recent informative 
surveys that concentrate on topics not covered here are the following: |H2] 
deals with estimates on Lipschitz domains, and [23 discusses applications 
obtained by inserting a so called twisting factor into the 3-complex. 

Although this paper concentrates on aspects of the 3-Neumann problem 
on domains in C n , we wish to mention a very important and fruitful de- 
velopment, namely the application of L 2 -methods to algebraic and complex 
geometry, and vice versa. For expositions of this very active area of research, 
we refer the reader to [HH1 EM [Ml EE! • 



It is of interest in several contexts to know whether or not the d- Neumann 
operator is, or is not, compact. Examples include global regularity (|7f)j). 
the Fredholm theory of Toeplitz operators(see e.g. [S3]); and existence or 
non-existence of Henkin-Ramirez type kernels for solving d ( 50 ). A fairly 
comprehensive discussion of compactness, up to about 1999, is in [46] . There 
one also finds complete proofs and/or references for background material. 
In this section, we review some recent developments. 

2.1 Sufficient conditions for compactness. In [201 Catlin introduced 
a sufficient condition for compactness which he called property (P). The 
boundary of a domain is said to satisfy property(P) if for every positive 
number M there are an open neighborhood Um of b£l and a plurisubhar- 
monic function Aju € C 2 (Um H with < Xm < 1, such that for all 
z € U M n 0, 



(This is somewhat more general than the formulation given in [201, but see 
also |46|.) Property(P) can be very nicely reformulated, on Lipschitz do- 
mains, in the spirit of Oka's lemma: the boundary satisfies property(-P) if 
and only if it locally admits functions p comparable to minus the bound- 
ary distance, such that the complex Hessian of — log(— p) tends to infinity 
upon approach to the boundary ([IS])- If the boundary of the bounded 
pseudoconvex domain satisfies property(P), then the d- Neumann operator 
N q on Q is compact, 1 < q < n (|2f)j. |87j when no boundary regularity is 
assumed). There are natural versions of property(P) for (0, g)-forms, see 
|46j : 1)2. 1|) is replaced by the requirement that the sum of the smallest q 
eigenvalues of the complex Hessian of Am should be at least M. Note that 
then P = P\ P2 ■ ■ ■ P n . This is appropriate, since compactness of 



2. Compactness 



(2.1) 
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N q likewise percolates up the complex: if N q is compact, then so is N q+ i (an 
observation due to McNeal ([Sj), see also the proof of Lemma 2 in |90|). 
A detailed study of property (Pi) is in [BE], where various equivalent charac- 
terizations are given (with some minimal boundary regularity required for 
equivalence to the definition we have adopted here, see [IHj, section 3). In 
particular, bO, satisfies property (Pi) if and only if every continuous function 
on bO, can be approximated uniformly on bVt by functions plurisubharmonic 
in a neighborhood of bVt. 

In 5-problems, the condition that a function be bounded can sometimes 
be replaced by the condition that the gradient of the function be bounded in 
the metric induced by the complex Hessian of the function (compare [S] and 
the references there). In the present context, this was realized by McNeal 
( |74j ) . Say that the boundary of the domain Q satisfies condition (P q ) if, 
for every M > 0, there exists Am £ C 2 (Um H fi), where Um is an open 
neighborhood of bfi, such that the sum of any q eigenvalues of its complex 
Hessian is at least M, and 



for all w £ C and z G Um H O. That is, <9Am is bounded uniformly in 
M in the metric induced by the Hessian of Am- McNeal f|74|) proved the 
following theorem. 

Theorem 2.1. Let Q be a bounded pseudoconvex domain in C n , 1 < q < n. 



Again note that Pi => P2 => • ■ ■ =>■ P n . Also, there is a weak formulation 
of 1)2.2(1 in terms of currents which is sufficient for Theorem 12. II see |74| for 
details. 

To prove Theorem 12.11 one uses that compactness of N q is equivalent to 
compactness of the canonical solution operators d* N q and d* N q+ i (or their 
adjoints, see e.g. [iB] . Lemma 1.1). Since (P q ) => (P g+ i), it suffices to estab- 
lish compactness of d N q . We sketch an argument (slightly different from 
McNeal's) to show how the hypotheses of the theorem enter (as well as for 
use in Remark l2.2l below'). We only consider (0, l)-forms for simplicity. Also, 
we assume that £1 is smooth and that A m is smooth up to the boundary (see 
|87| and [IS] for the regularization procedure in the non-smooth case). We 
may extend Am smoothly to all of £1 (by shrinking Um, where the estimates 
hold). The starting point is the classical Morrey-Kohn-Hormander inequal- 
ity ( |23|. Proposition 4.3.1, and the density Lemma 4.3.2). Taking the weight 
function to be Am an d computing the adjoint of d* in the weighted metric 
in terms of d and terms of order zero in u gives for u € Ker(3) D Dom(<9 ) 




2 



(2.2) 



If Q. satisfies condition (Pq), then N q is compact. 



.1 
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The constant in (|2.2|) may be assumed as small as we wish (by scaling 
A — > tX, see p. 199). Therefore, the last term in (|2.3j) can be absorbed 
into the left hand side, for z G Um- The result is, upon also applying 
()2.1j) . using interior elliptic regularity to estimate ||e _AM / 2 -u|| 2 (this 

term controls the various error terms), and absorbing terms: 
(2.4) ||e-W 2 n|| 2 < _L||r(e-W 2 u)|| 2 + C M \\e-^/ 2 u\\ 2 -i , 

when u € Ker(<9)nDom(<9*). Denote by B the standard Bergman projection, 
and by Bu, the Bergman projection in the weighted space with weight e^. Let 
v G Ker(d). Then v = B(e~ XM / 2 u), with u = B_x M / 2 {e XMl2 v) € Ker(d). 
We obtain 

(2-5) Ihll^^irHp + CMlle-W 2 ^/,^^)^^. 

For M fixed, the norm in the last term on the right hand side of 1)2. 5 Jl is 
compact with respect to ||v||, hence with respect to \\d v\\ (the canonical 
solution operator to d is continuous in L 2 ). Since M is arbitrary, this 
implies that (d Ni)*, the canonical solution operator to d* , is compact (see 
e.g [25], Lemma 1, [71], Lemma 2.1). This concludes the (sketch of) proof 
of Theorem 12. II 

It is easy to see that P q implies P q , by considering the family [iu '■= e Ajw , 
M > (see |74j for details). The exact relationship is however not under- 
stood. But there are two classes of domains where property(P,j) is known to 
be equivalent to compactness of N q , and hence condition (P g ) is also equiva- 
lent to both compactness of N q and property(-P 9 ). These are the bounded lo- 
cally convexifiable domains (with no boundary smoothness assumptions as- 
sumed beyond what is implied by local convexifiability (Lipschitz), |4ft | I4fi| ) 
and the smooth bounded Hartogs domains in C 2 (|27J)- In addition, (P) 
and (P) are known to agree for planar domains (HJJ, Lemma 7). Although 
conditional ) also appears naturally in connection with another important 
question in several complex variables, namely with that of the existence of 
a Stein neighborhood basis for the closure of the domain ([EH], (4.4) on p. 
317), it is not well studied at all. This is in stark contrast to property(P,j), 
where we have Sibony's theory ([SI]> see also [3S] when q > 1). It would be 
very interesting to have an analogous treatment of conditioning ). Finally, 
its connection with Stein neighborhoods suggests studying what the impli- 
cations of compactness in the 9-Neumann problem are for the existence of 
a Stein neighborhood basis for the closure. 

Compactness can be viewed as a limiting case of subellipticity. Subel- 
lipticity is equivalent to having a bounded plurisubharmonic function, near 
the boundary, whose Hessian blows up like a power of the reciprocal of 
the boundary distance (OE3) compare also [13 OS]). The only way to 
show the direction subellipticity =^ good plurisubharmonic functions that 
the author is aware of is via finite type of the boundary. It would be very 
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interesting to have a direct proof of this fact, arguing directly from the 
subelliptic estimates and bypassing the geometric arguments related to fi- 
nite type. If there is a reasonable characterization of compactness in terms 
of (potential theoretic) properties of the boundary (such as P/P or a slightly 
weaker property), it should emerge from such a proof when one extracts the 
features that remain valid in the limiting case. 

Remark 2.2. Takegoshi gives a sufficient condition for compactness in [M] 
which is a precursor to conditional ), in the sense that it replaces the uni- 
form boundedness condition on the functions in property (Pi) by a bounded- 
ness condition on the gradients. In fact, Takegoshi's condition implies (-Pi), 
but with (|2.2j) only for complex tangential tu's. But this is enough to prove 
Theorem 12. 1| because the forms to which one needs to apply the estimates 
are in the domain of d (see (|2.3|) above), so they are complex tangential 
(at points of the boundary, but the normal component of a form satisfies a 
subelliptic estimate, and so terms caused by it are under control). 

We next want to describe a technique for establishing compactness that 
does not rely on (P)/(P), introduced recently by the author ([EH])- Such 
a technique is of interest because it is not understood how much stronger 
(if at all) (P) is than compactness. Also, as will be seen, for domains in 
C 2 , this technique yields a sufficient condition that modulo a certain (albeit 
crucial) lower bound on certain radii is also necessary. 

Let VL be a smooth bounded pseudoconvex domain in C 2 . If Z is a (real) 
vector field defined in some open subset of bQ (or of C 2 ), we denote by J-^ 
the flow genearted by Z. In C 2 , the various notions of finite type coincide 
(see ^2 ), so we do not need to specify which notion we mean. Recall that 
the set of infinite type points in the boundary is compact. Finally, B(P,r) 
denotes the open ball of radius r centered at P. The following theorem is 
the main result in 89 . 

Theorem 2.3. Let be a smooth bounded pseudoconvex domain in C 2 . 
Denote by K the set of boundary points of infinite type. Assume there exist 
constants C\, C2 > 0, and C3 with 1 < C3 < 3/2, and a sequence {ej > 
0}^Li with limy-ftx, £j = so that the following holds. For every j G N and 
P € K there is a (real) complex tangential vector field Zpj of unit length 
defined in some neighborhood of P in b£l with max\divZpj\ < C\ such that 
F Zp . (P(P, C 2 (e) c ' A ) n K) C bn \ K. Then the d-Neumann operator on n is 
compact. 

The assumptions in the theorem quantify the notion that at points of K, 
there should exist a (real) complex tangential direction transversal to K in 
which bVt\K (the good set) is 'thick' enough. A geometrically very simple 
special case occurs when b£l\K satisfies a complex tangential cone condition 
(that is, the axis of the cone at a point P lies in a complex tangential 
direction). In this case, the assumptions in the theorem are satisfied with 
C 3 = 1 (see |HH3 for details). 
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Corollary 2.4. Let Q, be a smooth bounded pseudoconvex domain in C 2 . 
Denote by K the set of boundary points of infinite type. Assume that bCl\K 
satisfies a complex tangential cone condition (as an open subset ofbQ,). Then 
the d-Neumann operator is compact. 

The main idea of the proof of Theorem 12.31 is very simple. In order to 
derive a compactness estimate, what needs to be estimated is the L 2 -norm 
of a form u near K. To do this near a point P in K, we express u near P 
in terms of it in a patch which meets the boundary in a relatively compact 
subset of 60 \ K, plus the integral of the derivative of u in the direction 
Zpj. The first contribution is easily handled by subelliptic estimates, while 
the second is dominated by the length of the curve (which is £,•) times the 
L 2 -norm of Zpju on a certain subset of the boundary. But in C 2 , this norm 
is dominated by ||<9u|| + because Zpj is complex tangential (so called 

maximal estimates hold, c.f. jSZj)- When one sums up over the various 
patches (for a fixed j), overlap as well as divergence issues arise. These are 
handled by the uniformity built into the assumptions. 

The conditions in theorem [Tulare natural, and, in fact, modulo the size of 
the lower bound C2 (ej) Cz on the radius of the balls, necessary. Indeed, if N\ 
is compact, the boundary contains no analytic discs (since we are in C 2 , see 
|46| for a proof). This implies, by a result of Catlin (^B]> Proposition 3.1.12, 
see also |81| . Lemma 3) that for each point P £ K and for every e > 0, there 
is a complex tangential vectorfield Zp^ £ (of unit length) near P so that on 
the integral curve of Zp^ £ through P there is a strictly pseudoconvex point 
at distance (measured along the curve) less than e. Then there is a ball 
B(P,r) which is transported, for t = s, by the flow generated by Zp <e , into 
the points of finite type: it suffices to take r small enough. Since there 
are smooth bounded pseudoconvex domains in C 2 without discs in their 
boundaries, but whose d- Neumann operator is not compact ([73], US])) this 
discussion also shows that without a lower bound on r, the conclusion of the 
theorem does not hold. The lower bound given in Theorem 12.31 is probably 
not optimal. An 'optimal' bound (if one exists), in a sense to be made 
precise, would be of great interest: in light of the above discussion, such 
a bound essentially amounts to a characterization of compactness in the 
d- Neumann problem on domains in C 2 . 

Theorem 12 . 31 does not hold in dimension n > 2. Consider a convex domain 
with a disc in its boundary. When n > 2, there is an additional complex 
tangential direction in which to flow, so that the assumptions in Theorem l2.3l 
can be satisfied. Yet such domains have noncompact 9-Neumann operator 
( |45j ) . Since the only place where the proof uses that the domain is in C 2 
is the invocation of maximal estimates, an obvious generalization to C n is 
to require the domain to satisfy maximal estimates (equivalently: all the 
eigenvalues of the Levi form are comparable, see [S3)- There is, however, a 
more interesting generalization in [7JI]. It suffices to be able to flow into 
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the set of finite type points along curves whose tangents lie in a complex 
tangential direction associated with the smallest eigenvalue of the Levi form. 

The author does not know examples of domains that satisfy the assump- 
tions in Theorem 12, 3( but do not satisfy condition(P). As far as just assert- 
ing compactness of the 9-Neumann problem on the domains in the theorem 
is concerned, it does not matter whether or not these domains always satisfy 
(P): we have, in any case, a simple geometric proof of compactness for these 
domains. However, from the point of view of understanding to what extent 
(P) is necessary for compactness, this question is obviously very important. 

2.2 Obstructions to compactness. An analytic disc in the bound- 
ary constitutes the most blatant violation of condition(P) as well as of the 
condition in Theorem 12.31 This is obvious for the condition in Theorem 
12.31 (recall that the setup is in C 2 ). For condition (P), this can be seen by 
pulling back the plurisubharmonic functions to the unit disc D in the plane: 
there do not exist subharmonic functions in D satisfying (J2.1)) and Q2.2|) for 
arbitrarily large M (compare Appendix A in [Mj)- Indeed, integration by 
parts and (|2~2j) give for u € Cq°(D) 



(2.6) 



d 2 X 

D dzdz 



u 



r d 2 x 


f dX du 










+ 


L 


Id dz&z UU ~ 







dX du 



< 



D 



dX 



dz 



\u\ 2 + 



D 



du 



dz 



< C 



d 2 x 

D dzdz 



u 



D 



du 



dz 



where C is the constant from (|2.2|) . We have used here that ||9u/<9z|| 2 = 
||(9u/(?2;|| 2 . As pointed out earlier, C may be taken as small as we wish. 
Taking a family with C = 1/4 in Q2.2|) (hence in l|2.6|l ) and combining with 
(JHU gives 



(2.7) 



M 
T 



< 



inf 



II 



D 



I dz I 



(°) Si 



D 



\U\ 



(The infimum on the right hand side of (|2.7|) is (up to a factor 1/4) the 
smallest eigenvalue of the Dirichlet realization of - A on D.) In the case of 
property(P), this is of course also an obvious consequence of its characteri- 
zation (see above) by the approximation property by continuous functions. 
A disc in the boundary is also known to be an obstruction to hypoellipticity 
of d ( |17| 141 j ) . It is therefore very natural to ask whether such a disc is an 
obstruction to compactness of the 9-Neumann operator. 

An old folklore result, usually attributed to Catlin, says that this is indeed 
the case for sufficiently regular domains in C 2 . A proof for the case of 
Lipschitz boundary may be found in There, a simple example (the 

unit ball in C 2 minus the variety {z\ = 0}) is given that shows that some 
boundary regularity is needed. Whether for domains in C 2 there can be 
other obstructions to compactness was resolved only surprisingly recently. 
Matheos (|73j) showed that there are indeed more subtle obstructions: 
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Theorem 2.5. Let K be a compact subset of the complex plane with non- 
empty fine interior, but empty Euclidean interior. There exists a smooth 
bounded complete pseudoconvex Hartogs domain in C 2 with the following 
properties: (i) its set of weakly pseudoconvex boundary points projects onto 
K, (ii) it contains no analytic discs in its boundary, (Hi) its d -Neumann 
operator is not compact. 

For properties of the fine topology, see e.g. [22], EE!- section 3; in particular, 
there do exist (many) sets K as in the theorem (an explicit construction of 
such sets may also be found in section 4 of |27|). The version of the theorem 
given here comes from [Hi] , to where we refer the reader for details (compare 
also |27j ) . Note in particular that this also means that there are more subtle 
obstructions to property(P)/condition(P) than discs in the boundary. This 
was known before, see |83j . 

Remark 2.6. It is easy to see that on a smooth bounded complete pseudo- 
convex Hartogs domain in C 2 , there is no disc in the boundary if and only if 
the projection of the weakly pseudoconvex boundary points has empty Eu- 
clidean interior. It will be seen in subsection 2.3 below that the 3-Neumann 
operator is compact if and only if this set has empty fine interior (as a 
compact subset of C); see the discussion following Theorem 12. Ill 

Remark 2.7. Whether on a smooth bounded pseudoconvex domain in C 2 
the absence of discs from the boundary implies global regularity is open. 

It is folklore that the methods that work in C 2 can be used in C n to 
show that when the 9-Neumann operator N% is compact, the boundary 
cannot contain an (n— l)-dimensional complex manifold. However, whether 
a disc is necessarily an obstruction is open in general, and is arguably the 
most important problem concerning compactness. §ahutoglu and the author 
recently showed that when the disc contains a point at which the boundary 
is strictly pseudoconvex in the directions transverse to the disc ([E3)> then 
compactness does fail. This holds more generally for complex submanifolds 
of the boundary of arbitrary (positive) dimension. 

Theorem 2.8. Let Q, be a smooth bounded pseudoconvex domain in C n , 
n > 2. Let p € b£l and assume that the Levi form of 6f2 at P has the 
eigenvalue zero with multiplicity at most k, 1 < k < n — 1 (i.e. the rank is 
at least n — 1 — k). If the d-Neumann operator on (0, l)-forms is compact, 
then 6fi does not contain a k-dimensional complex manifold through P. 

It follows immediately from the theorem that if the set K of weakly pseu- 
doconvex boundary points has nonempty relative interior in the boundary, 
then the 9-Neumann operator (on (0, l)-forms) is not compact (|81j). It 
suffices to observe that near a relative interior point of K where the Levi 
form attains its maximal rank (among points of the relative interior of K), 
say m, the rank has to be constant, so that the boundary is foliated there 
by complex manifolds of dimension n — 1 — m. Note that in general, K is 
considerably bigger than the set of Levi flat points. 
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The proof of Theorem 12.81 results from the following ideas. Compactness 
is a local property (see JIB], Lemma 1.2). Therefore, it suffices to argue 
locally. Assume the boundary contains a complex manifold, say M. There 
is a holomorphic change of coordinates near P so that in the new coordinates 
M is affine, and the real normal to the boundary of is constant on M. This 
is always possible (jH5> Lemma 1). Next, consider a section 0± of through 
P, perpendicular to M. If f^i has a subdomian 0,2, whose boundary shares 
P with bO and such that (i) the restriction operator from the Bergman 
space of fij. to the Bergman space of O2 is not compact, and (ii) the product 
0,2 x M is contained in O (near P), then the arguments from 45 (which in 
turn are based on ideas from |171 141j ) carry over to produce a contradiction 
to the existence of a compact solution operator to d (which would be a 
consequence of compactness of N\). In the situation of Theorem 12.81 any 
smooth subdomain 0,2 will do, because 0± is strictly pseudoconvex at P 
(|81j. Lemma 2). If we take for O2 a ball with small radius and tangent to 
bOi at P, (ii) also holds (because the real normal to bO is constant along 
M). 

Experience indicates that a flatter boundary should be even more favor- 
able to noncompactness of the 3-Neumann operator. In other words, the 
extra assumption that the boundary is strictly pseudoconvex in the direc- 
tions transverse to M should not be needed. However, the present methods 
do not seem to yield this. An interesting recent contribution to this circle 
of ideas, involving the Kobayashi metric of the domain, is in |61| . 

The above proof of Theorem 12.81 also raises a question of independent 
interest. Namely given a domain O and a subdomain Oi, when is the re- 
striction operator from the Bergman space of to that of Oi compact? Of 
course, this happens when 0\ is relatively compact in O, so the case of inter- 
est is that where the domains share a boundary point. As mentioned above, 
it is also known to happen when is smooth near a strictly pseudoconvex 
boundary point P and bO\ shares P with bO and is smooth there (|81|. 
Lemma 2). In addition, this restriction is known to be compact when is 
convex, P = € bO, and Oi = rO, for r < 1 ( 45 ). The general situation is 
not understood. 

2.3 Hartogs domains in C 2 and semi-classical analysis of Schrodinger 
operators. It is well known that d and related operators on Hartogs do- 
mains can be studied by means of weighted operators on the base domain. 
In the sequel, the base domain U will be a planar domain (i.e. the Har- 
togs domain is in C 2 ). The resulting weighted problems lead to Schrodinger 
operators on U, see for example [Ej and the references there. 

Let U be a bounded domain in C, (p(z) € C 2 (U). Denote by the 
Schrodinger operator with magnetic potential A = — (d(f>/dy)dx+(d(p/dx)dy, 
magnetic field dA = Acf)(dx A dy), and electric potential V = A<p. That is, 
is given by (the Dirichlet realization of) 

(2.8) St = - [(d/dx + idcp/dy) 2 + (d/dy - id^/dx) 2 ] + A</> . 
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Denote by 59 the corresponding nonmagnetic Schrodinger operator, given 
by (the Dirichlet realization of) 

(2.9) S*> = -A + A0. 

For (very) brief introductions to Schrodinger operators, we refer the reader 
to |47j . section 2 or [27], section 2.3. For a detailed treatment in the context 
of semi-classical analysis relevant here, see |51| 

Let f2 be a bounded complete pseudoconvex Hartogs domain in C 2 given 
by $7 = {(z,w) G C 2 : z G U, \w\ < e~^( z ^}, where U is a domain in C. Note 
that pseudoconvexity forces <j> to be plurisubharmonic. Also, smoothness 
of Vl means that (f> is smooth on U, but not on U, but the notions needed 
here are still well defined, compare (IT], [27] . The rotation invariance in 
the w variable brings a discrete Fourier variable into play, and so what one 
actually has when analyzing the d and related problems on Hartogs domains 
are sequences of Schrodinger operators of the form {S n( f,}^ =1 and {S®^}™^, 

respectively (see (37] for details). Compactness of the 3-Neumann operator 
on Q is closely linked to the behavior of the sequence of lowest eigenvalues 
{^n4>}^Li (the ground state energies) of the magnetic Schrodinger operators, 
while property(P) of bQ is similarly linked to the behavior of the sequence 
{^n^n^i °f l° wes t eigenvalues of their nonmagnetic counterparts. The for- 
mer idea originates with |7Hj . the latter with [UJ. The precise relationships 
are given in the following theorem ( |47j ) . 

Theorem 2.9. Let = {(z,w) G C 2 : \w\ < e~^ z \z G U} be a smooth 
bounded complete pseudoconvex Hartogs domain. Suppose that b£l is strictly 
pseudoconvex on b£l n {w = 0}. Then 

(1) bil satisfies property (P) if and only if A^. — > oo as n — > oo. 

(2) The d-Neumann operator on £1 is compact if and only if \ n( f> — > oo. 

We remark that for the domains in Theorem 12. 9( property (P) and property 
(P) are equivalent (|47|. Lemma 6). It was already noted in 07] that for 
some of the implications, regularity of the boundary is not needed. For a 
version of Theorem 12.91 that assumes very little regularity of (f), see |27| . 

It is the limit in part (2) of Theorem l2.9l that gives rise to the terminology 
used in the title of this subsection. Note that S n $ = —n 2 [((l/n)(d/dx) + i(d<p/dy)) 2 + 
{{l/n){d / dy) — i(d(f)/dx)) ]+nAcj). Understanding the behavior of the ground 
state energy as n tends to infinity is thus analogous to understanding (mod- 
ulo the factor n 2 ) what happens when 'Planck's constant' h = 1/n tends 
to zero. This situation is typically referred to as semi-classical analysis in 
the mathematical physics literature. Mathematical physics also has its own 
version of (1) (2): Simon's diamagnetic inequality asserts that < A n 
(|84j. see also jSO])- Reverse relationships, when there is some kind of dom- 
ination of the magnetic eigenvalues by the nonmagnetic ones, obviously of 



11 



EMIL J. STRAUBE 



interest in our context, are known in the physics literature as paramag- 
netism. For more thorough discussions of these topics, we refer again to 
[5T] . |4"7) . and [22j, and their references. 

This point of view has allowed to clarify the relationship between property(P) 
and compactness of the 3-Neumann operator on the (special) class of Har- 
togs domains in C 2 . Namely, Christ and Fu recently established the para- 
magnetic property required for the implication (2) (1) in Theorem 12.91 

Theorem 2.10. Let (ft be subharmonic on the domain U C C, and suppose 
that Acj) is Holder continuous of some positive order. If sup n A^ < oo then 
liminf^oc < oo. 

Since the sequence {A^}^^ is increasing (this is obvious from (|2.9|) : <fi is 
subharmonic), we immediately get the corollary that on the domains from 
Theorem 12. 91 property (P) and compactness of the 9-Neumann operator are 
equivalent. In fact, combining this with some additional work, Christ and 
Fu (|27j) were able to handle general (not necessarily complete) Hartogs 
domains, thus establishing the following equivalence. 

Theorem 2.11. Let f2 C C 2 be a smooth bounded pseudoconvex Hartogs 
domain. The d -Neumann operator on VL is compact if and only ifbVt satisfies 
property (P). 

While we have not made an effort to state Theorem 12.111 with optimal 
boundary smoothness assumptions (see HZj), we point out that in view of 
the example mentioned before the statement of Theorem l2.5| some boundary 
regularity is needed for the equivalence in Theorem 12.111 to hold. If the 
Hartogs domain is complete, then the two properties in Theorem 12.111 are 
also equivalent to the set K (as defined above) having empty fine interior, 
by work of Sibony. Namely, b£l satisfies property(P) if and only if K does 
(as a subset of C, [HSj, p. 310). In turn, K satisfies property(P) if and only 
if it has empty fine interior (jHSj) Proposition 1.11). 

3. Global regularity 

The 3-Neumann operator N q is said to be globally regular if it maps 
C°°(0, q)(p) (necessarily continuously) into itself. It is said to be exactly 
regular if it maps W? m to itself for s > 0. Exact regularity implies of 
course global regularity. So far, in all instances where one can prove global 
regularity, one actually proves exact regularity. On the worm domains, 
failure of global regularity ( 24^ ) is proved via failure of exact regularity ( L 3 j ) : 
for most s, exact a priori estimates hold in W s (£l), and global regularity 
would then give exact regularity. It is consistent with what is known that 
such a priori estimates might hold on all domains (they are also known to 
hold on the nonpseudo convex counterexample domains from [2], see |12j). 
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For a survey of results up to about ten years ago, we refer he reader to 
|14j . In this section, we first discuss regularity on domains whose bound- 
ary contains an open patch foliated by complex hypersurfaces ( |92| I44j . In 
subsection 3.2, we describe a unified approach to global regularity ( |91[ l90j). 

We recall the following important 1-form on the boundary of a domain. 
Let be a smooth bounded pseudoconvex domain. Denote by rj a purely 
imaginary nowhere vanishing 1-form on bVl that annihilates the complex 
tangent space and its conjugate. Let T denote the purely imaginary vector 
field on b£l orthogonal to the complex tangent space and its conjugate and 
such that r](T) = 1. The real 1-form a is defined by a = —jCttj, the Lie 
derivative of rj in the direction of T (compare |311 I32|). The form arises 
naturally in the computation of (normal components of) commutators of 
vector fields; indeed, if rj = dp— dp, and X is a local section of T 0,1 (bQ), then 
a{X) = 2dp([L n , X]) (L n is the complex normal). The cohomology class on 
complex submanifolds of the boundary mentioned in the introduction in 
connection with ^3] is the class of a. 

3.1 A foliation in the boundary. Background on foliation theory and 
notions used here can be found in ^3] and as well as in [52], |44j . 
and their references. Assume now there is a codimension one foliation in 
the boundary, say the relative interior of the set K of weakly pseudoconvex 
points is foliated by complex manifolds of dimension n — 1. Note that such 
a foliation is always transversely orientable (by the vector field T defined on 
all of b£l). In order to run the machinery from |ll[ H3j. one needs a function 
h smooth in a relative neighborhood of K, satisfying 

(3.1) dh\L = ol\l > for all leaves L . 

For details, see |92| . Of course, this requires that the restriction of a to a leaf 
is closed. This does indeed hold: da\j^ p = always, where Mp is the null 
space of the Levi form at P, see the lemma in section 2 of |13j . Thus solving 
1)3.1(1 is always possible locally. Globally, topological constraints arise. Also, 
the boundary behavior of h on K needs to be controlled. 

It turns out that these issues are very much related to ones studied in 
foliation theory. Note that the foliation can be defined by ??: the tangent 
planes to the leaves are given by the null space of r\. Then the Frobenius 
condition reads dr] A rj = 0. Hence dr] = (3 A r) for some 1-form (3. a is such 
a form, that is 

(3.2) dr] = a At] on K 

f|9*H]. Proposition 2.2). With ()3.2jl . solving (|3.1j) is easily tied to an impor- 
tant property in foliation theory (|92|). 

Lemma 3.1. (|3.1|) can be solved (say on the relative interior of K) if and 
only if the Levi foliation of K can be defined globally by a closed 1 -form. 

Indeed, if u; is a 1-form defining the foliation, then u> = e~ h r], and 

(3.3) duj = d(e~ h r]) = e' h (-dh /\r] + dr]) = e~ h (-dh + a) A r? . 
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Therefore, 

(3.4) doj = ^ (-dh + a) A rj = -dh\ L + a\ L = . 

In addition to closedness of ol\l, solvability of (|3.1)l also requires that the 
De Rham cohomology class of cx\l vanishes. This again fits nicely into the 
foliation framework: this cohomology class coincides with the infinitesimal 
holonomy of L (|92j. Remark 2, [T^], Example 2.3.15). 

We first present a result in C 2 from |92j . The relative boundary of K in 
bCl, say T, is assumed smooth, and so is a smooth compact orientable surface 
embedded in C 2 . Recall that a complex tangency at a point of T is called 
generic if it is either elliptic or hyperbolic (see [55] for more information). 
Note that at a hyperbolic point there are locally two leaves that meet. 

Theorem 3.2. Let Q be a smooth bounded pseudoconvex domain in C 2 . 
Suppose that the set K of infinite type points of bVt is smoothly bounded 
(in bQ) and that its boundary T is connected and has only isolated generic 
complex tangencies. Assume that the two leaves meeting at a hyperbolic point 
are distinct globally and that they have no other hyperbolic points in their 
closure (in K). If each leaf of the Levi foliation is closed (in the relative 
interior of K) and has trivial infinitesimal holonomy, then the d-Neumann 
operator on f2 is continuous on W? Q y(^) for s > 0. 

If one assumes that the Levi foliation of K is part of a foliation of a 
bigger smooth Levi flat hypersurface M, with M n f2 = K, then boundary 
behavior of the leaves is easier to control, and one needs no conditions on 
the boundary of K. This results in a geometrically appealing sufficient 
condition. The following theorem is from |44j . A codimension one foliation 
is called simple if through every point there exists a local transversal (a line) 
that meets each leaf at most once. 

Theorem 3.3. Let Q, C C n be a smooth bounded pseudoconvex domain such 
that the set K of all boundary points of infinite D'Angelo-type is the closure 
of its relative interior in b£l. Assume K is contained in a smooth Levi-flat 
(open) hypersurface M C C n , whose Levi foliation satisfies one (hence both) 
of the following equivalent conditions: (i) the leaves of the restriction of the 
foliation to a neighborhood of K are topologically closed (ii) the foliation is 
simple in a neighborhood of K . Then, the d-Neumann operators N q on Q 
are continuous in WfL g )(^) f or s > 0, 1 < q < n. 

Very roughly speaking, in both Theorems 13.21 and 13. 3( one would like to 
obtain a closed form that defines the foliation by pulling back from the leaf 
space (which is one dimensional) a form roughly like dx. One then has to 
deal with the non-Hausdorff nature of this space. In Theorem 13.21 one also 
has to control the boundary behavior. 

It is interesting to note that the main concern in [31] is not the d- Neumann 
problem, but rather holomorphic convexity properties of compact subsets of 
M. The authors use asymptotically pluriharmonic defining functions for M 
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(near a compact subset) for constructing Stein neighborhoods, and whether 
such defining functions exist leads precisely to the question whether the 
foliation, near the compact set (globally), can be defined by a closed 1- 
form. In view of Lemma 1.3.11 this is related to the equivalence between 
'pluriharmonic defining functions' and 'exactness of a in |3J (see Theorem 
13.41 below). In a local context, compare also [3]. 

The two equivalent conditions in Lemma l3.1l are equivalent to a third one, 
given in terms of the flow generated by T ([22]) Proposition 2). This is at 
least potentially of interest because the condition is in terms of T, (rather 
than the Levi foliation), which is well defined on the boundary of any smooth 
domain. Furthermore, this leads to a homological necessary and sufficient 
condition for the existence of a function h E C°°(K) as above ([32]) Theorem 
3), in terms of foliation currents ( |93l II 5j ) associated to T. 

3.2 Sufficient conditions for global regularity. In ^5], Remark 3 in 
section 4, the authors point out that the families of vector fields with good 
approximate commutator conditions with d, required in their approach to 
global regularity ( |HM13j ) can exist in situations where the domain does not 
admit (even a local) plurisubharmonic defining function. On the other hand, 
they had noted in that it suffices to have the commutator conditions 
with components of d in directions that lie in the null space of the Levi form. 
For this, positivity of the Hessian of a defining function at a boundary point 
is needed only on the span of the null space of the Levi form and the complex 
normal. The situation was cleared up in j3J : the authors showed that the 
vector fields and the plurisubharmonic defining functions approaches can be 
reformulated naturally and then become equivalent. 

Let be a smooth bounded pseudoconvex domain. Say that f2 admits a 
family of essentially pluriharmonic defining functions if there exists a fam- 
ily {p e }e>o of defining functions with gradients bounded and bounded away 
from zero on b£l uniformly in e, such that the complex Hessian of p E is 0(e) 
on the span, over C, of Mp and L n (P), for all P € b£l. We emphasize that 
this notion is indeed a generalization of the notion of a plurisu&harmonic 
defining function (see [31]). We say that the form a (see above) is approx- 
imately exact on the null space of the Levi form if there exists a family 
{h e }e>o of functions smooth in neighborhoods U e of the set K of bound- 
ary points of infinite D'Angelo type, bounded uniformly in e, such that 
dh\j\f p = a\j\f p + 0(e) for all P G K. A family of conjugate normals which 
are approximately holomorphic in weakly pseudoconvex directions is defined 
similarly; see [3^ , where Sucheston and the author established the following 
equivalence (compare also the remarks in section 5 of [30] concerning (Hi)). 

Theorem 3.4. Let O be a smooth bounded pseudoconvex domain in C n . 
The following are equivalent: 

(i) Q admits a family of essentially pluriharmonic defining functions. 

(ii) £1 admits a family of conjugate normals which are approximately holo- 
morphic in weakly pseudoconvex directions. 
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(Hi) admits a family of vector fields as in ^3] • 

(iv) The form a is approximately exact on the null space of the Levi form. 

The equivalence to condition (ii) is of interest because the existence of such 
a family leads, under favorable circumstances (K is uniformly H-convex), to 
the existence of transverse vector fields holomorphic in a neighborhood of 
K, and these lead to Stein neighborhood bases for O and to Mergelyan type 
approximation ([IB], jS], 0U). 

Theorem 13.41 shows that the approaches to global regularity in the d- 
Neumann problem through plurisubharmonic defining functions and through 
good vector fields are really equivalent. Left unanswered was the question 
of how to unify this approach with that via compactness. This is achieved 
in the following theorem from |90j . 

Theorem 3.5. Let Q, be a smooth bounded pseudoconvex domain in C n , p 
a defining function for Q. Let 1 < q < n. Assume that there is a constant 
C such that for all e > there exists a defining function p £ for Q, and a 
constant C e with 

(3.5) 1/C < \Vp E \ <C onftfi, 

and 
(3-6) 




A d 2 p £ dp j 



<e[\\du\\ 2 + \\d\f )+C £ \\u\\ 2 _ 1 



for all u G CZ> JQ) n Dom(<9 ). Then 

(3.7) ll-^^lls < Cs||«||s , 

for s > and all u G WL q }(Q)- 

Notice that the assumptions in Theorem 13.51 are for g-forms, q fixed. It 
is not hard to see that when they are satisfied at level q, then they are 
satisfied at level q + 1 (jHOl) Lemma 2). It would be interesting to know 
whether global regularity similarly moves up to higher form levels (recall 
from section 2 that subellipticity and compactness do). 

The simplest situation occurs when there is one defining function, say p, 
that works for all e. This covers the case when N q is compact: the left hand 
side is in this case bounded by ||u|| 2 independently of e, and compactness 
says precisely that \\u\\ 2 can be bounded in the manner required by the right 
hand side of (|3.6j) (this is the right hand side of a compactness estimate) . 

When Q admits a defining function p that is plurisubharmonic at the 
boundary, p e = p for all e also works. Assume q = 1 for the moment. Apply- 
ing the Cauchy-Schwarz inequality to the left hand side of (|3,6[) at boundary 
points gives that this left hand side is dominated by || ^{d 2 p/ dzjdzk)ujllk\\ 2 
plus a term of order p plus a compactly supported term. The latter two are 
benign for (|3.6|) . Estimating the former in the way required in (|3.6f) is 
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immediate from the fact that the Hessian of a defining function acts as a 
subelliptic multiplier of order 1/2 on 1-forms ([HS], section 6.4.2). When 
q > 1 , one can reformulate (|3.6j) so that the left hand side of the inequality 
involves a pairing between g-forms (|90|. Lemma 1), and the above argument 
works under the weaker assumption that the sum of any q eigenvalues of the 
Hessian of p is nonnegative. In view of the equivalence results in JHj) this 
recovers, in the pseudoconvex recent result of Herbig-McNeal (|55|). 

where the authors prove Sobolev estimates for the Bergman projection on 
j-forms, q — 1 < j < n, under this weaker assumption. 

More generally, the sufficient conditions for global regularity from Theo- 
rem |23] imply those in Theorem 13.51 

Proposition 3.6. Let Q be a smooth bounded pseudoconvex domain in C n . 
Assume Q satisfies one (hence all) of the equivalent conditions in Theorem 
\3.4\ Then the assumptions in Theorem \3.FA are satisfied for q = 1, 2, • • • , n. 

We indicate what is involved, details are in j^JJj, Proposition 1. Assume 
{i) in Theorem 13.41 It suffices to consider the case q = 1. Fix e. Then 
Lp £ (z)(w) = 0(e)\w\ 2 when (z,w) is in a neighborhood U £ of the compact 
subset {(z,w) : w G Af z } of the unit sphere bundle in T 1,0 (M7). Here, L g 
denotes the complex Hessian of a function g. There is a constant C £ such 

' 2 <C 
z G b^l, w G TWQ&l): 

2 



that \w\ 2 < C £ L Ps (z)(w) when (z,w) ^ U £ . This implies the estimate, when 



d 2 Pe , x dp 

^— ' OZjOZk OZj 



~ n d 2 n 



(3.8) 

j,k=l 

(since both terms on the right are nonnegative). By continuity and homo- 
geneity, (|3,8|) holds near (depending on e) the boundary. To verify ()3.6|) for 
u G C^^(^l), it suffices to apply (|3.8|) to u pointwise, near the boundary 
(the normal component of u is zero only on the boundary, but it satisfies a 
subelliptic estimate, so is under control). In view of the discussion preceed- 
ing the statement of Proposition I3.6| integration over Q now gives ()3.6|) . 

It should not be surprising that condition (|3.fij) has a potential theoretic 
flavor: global regularity probably is not determined by geometric conditions 
alone (unlike the much stronger property of subellipticity). However, it is 
not hard to extract a geometric sufficient condition from (|3.(i|) , compare 90 , 
section 2. What one arrives at is precisely condition (i) in Theorem 13 .41 In 
other words, the vector field approach constitutes what might be called the 
geometric content of Theorem \S.^\ 

It is noteworthy that whether or not a family of defining functions satisfies 
(|3.5j) and (|3.6j) is determined entirely by the interplay of the gradients with 
the boundary. That is, if a family {p e } e >o satisfies ([3.5)1 and (|3,6[) . and 
{Pe}e>o is another family such that V(^) = V(/) e ) for all e and all z G 
then {p £ } £ >o also satisfies (|3.5j) and (|3.6|) (possibly after rescaling). For 
details, see jHUj, Remark 2. 
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At the level of a priori estimates, a proof of Theorem 13.51 follows from a 
small modification of the ideas in |ll|H3j. We briefly indicate what changes, 
keeping the general setup from This will show how (|3.6|) enters into 

the estimates. Set X £ = e~ he Y^{dp/3zj)(d/dzj), where h £ is defined by 
p £ = e he p, and p is a defining function with normalized gradient (all of 
this is near 6f2, away from 60, any smooth continuation will do). For the 
Bergman projection P, the key quantity to be estimated is 

(3.9) \\<p(X e - X~ £ )Pf\\ 2 < (N 1 df,<p 2 (X E -X~ £ )[d,X £ -JQPf)+o.k. , 

where 'o.k.' stands for terms that are under control or can be absorbed, 
and <p is a smooth cutoff function supported near the boundary (see p. 
83-84). One needs to control the normal component of the commutator in 
()3.9|) . In contrast to we do not have a pointwise estimate on this normal 
component. But there is some slack built into the argument in in that 
there the contribution from the commutator of X £ — X £ with each component 
of d is estimated separately. If one takes this into account, computing the 
commutator gives the main term (after integrating X £ — X £ back to the left) 

(as opposed to estimating Ylk=i " ' f° r each j, j = 1, • • • , n). The term 
in the left hand side of this inner product is now (the conjugate of) one 
to which (|3.6|) can be applied. (As usual, we let X £ — X £ act in special 
boundary charts so that it preserves Dom(<9 ).) Note that X £ = e he L n , and 
that e he is bounded independently of e. Consequently (by (|3,6j0 . the square 
of the L 2 -norm of this term is dominated by 

(3.11) e (\\d(L n - L^^dfW 2 + \\d*(L n - Ln)N x dff) 

+ C £ \\(L n -Ln)N l dff_ 1 

<^(l|A f i9/||? + ||riV 1 5/||?)+C7 e ||/|| 2 . 

From here on, the argument proceeds as in in particular, in the setup 
of the downward induction on q there, N\d is 'as good as' P. Absorbing 
terms, one arrives at the required a priori estimate (compare p. 84-85 in 

mi)- 

The situation changes rather markedly with regard to genuine estimates. 
In the authors simply observe that the estimates can be carried out 
uniformly on suitable approximating strictly pseudoconvex subdomains, by 
using the same family of vector fields. By contrast, the assumptions in The- 
orem do not seem strong enough to be inherited by these approximating 
subdomains. Therefore, one has to employ some other regularization proce- 
dure, such as elliptic regularization. This makes the argument considerably 
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more involved, and the author derives in [HD] certain needed new estimates 
for the regularized operators. This is also in contrast to [2Sj, where the re- 
sults of are proved working directly with the 9-Neumann operator and 
using elliptic regularization. There too it is the strength of the pointwise es- 
timates on the size of the normal component of the commutators that makes 
elliptic regularization routine (once the derivation of the a priori estimates 
is in place). 

Note that to get estimates at a fixed Sobolev level k, it suffices to have 
(13, 6|) in Theorem 13.51 for some e = e(k). Kohn (|HZJ) has proved estimates 
where the level in the Sobolev scale up to which estimates hold is tied to 
the Diederich-Fornaess exponent ( 39 ) of the domain. The discussion above 
of Proposition 13.61 combined with |88j , where the plurisubharmonicity of 
— log(— p) is exploited, suggests that it should be possible to obtain results 
of this type by the methods in 90 . 

Remark 3.7. Consider the operator A p from Dom(<9) nDom(<9*), provided 
with the graph norm, to L 2 (Q), given by 

(3.12) A p {u) = TT-^jf^ , « G Dom(d) n Dom(d*) . 

. , . OZjOZfc OZj 
J,k=l J J 

Then ()3.6|) holds with p £ = p for all e precisely when A p is compact (see 
e.g. |22| . Lemma 1, [71], Lemma 2.1). The form of A p suggests that one 
study sesquilinear forms that produce compact operators via (|3.12|) . It is 
possible that there is a theory of 'compactness multipliers'. We mention that 
compactness of A p for a suitable defining function p is considerably weaker 
than compactness of N\ . It holds on all convex domains (since they admit a 
plurisubharmonic defining function), yet N\ is compact (if and) only if the 
boundary of the domain contains no analytic disc ( |45| ). 
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